Modeling Medical Treatment Using Markov Decision Processes
نویسندگان
چکیده
منابع مشابه
Accelerated decomposition techniques for large discounted Markov decision processes
Many hierarchical techniques to solve large Markov decision processes (MDPs) are based on the partition of the state space into strongly connected components (SCCs) that can be classified into some levels. In each level, smaller problems named restricted MDPs are solved, and then these partial solutions are combined to obtain the global solution. In this paper, we first propose a novel algorith...
متن کاملDynamic Influence Diagrams: Applications to Medical Decision Modeling
Influence diagrams are now a well established tool for modeling in decision analysis. Recently, dynamic influence diagrams have been applied to help structure stochastic processes. This chapter discusses dynamic influence diagrams for structuring continuous-time Markov chains, with particular focus on medical decision modeling. We describe our freely available Excel-based software package StoTr...
متن کاملMarkov decision processes: a tool for sequential decision making under uncertainty.
We provide a tutorial on the construction and evaluation of Markov decision processes (MDPs), which are powerful analytical tools used for sequential decision making under uncertainty that have been widely used in many industrial and manufacturing applications but are underutilized in medical decision making (MDM). We demonstrate the use of an MDP to solve a sequential clinical treatment proble...
متن کاملEffects of Methadone Maintenance Treatment on Decision-Making Processes in Heroin-Abusers: A Cognitive Modeling Analysis
A B S T R A C TIntroduction: Although decision-making processes have become a principal target of study among addiction researchers, few researches are published according to effects of different treatment methods on the cognitive processes underlying decision making up to now. Utilizing cognitive modeling method, in this paper we examine the effects of Methadone maintenance treatment (MMT) on ...
متن کاملAn Application of Inverse Reinforcement Learning to Medical Records of Diabetes Treatment
It is an important issue to utilize large amount of medical records which are being accumulated on medical information systems to improve the quality of medical treatment. The process of medical treatment can be considered as a sequential interaction process between doctors and patients. From this viewpoint, we have been modeling medical records using Markov decision processes (MDPs). Using our...
متن کامل